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V6. Abstraci.s This IS the final report of the development of a Work -Re levant 
Attitudes' Inventory (WRAI) for use in diagnosing the needs of indivi- * 
duals and evaluating the effectiveness of manpower programs. T^e WRAI 
was used in two longitudinal studies: four NYC programs with 502 sub- 
'jects and a de^lonstrat ioii educatioja project with 526 subjects. Thit 
WRAI was able to differentiate betweefi subjects making a "good^ aaid a 
"poof" adjustment to work; Furthermore, positive changes in WRAI 
scores were associated with a "good'* adjustment. The WRAI also corre- 
lated with counselor ratings and with achievement test scores in^ 
reading and. mathematics . it was concluded that the/ WRAI had- demon- 
strated its usefulness as a measure of program "effectiveness and as 
a help in diagnosing the needs of new program participants'. 
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SUMMARY ' - ' . ( 



The research reported here is the final phase of a 
_ng term effoi:^ to develop a Work-Relevant Attitudes ~ 

Inventory <WRAI> for use in driagho«ing ±he needs of in- 

dividuals and evaluating the effectiveness^ of manpower 
programs. In early studies items were identified which 
differentiated between criterio^j^r6ups . From the irii- 
tial 72 items, 26 were selected for use. in the current 
^studies, and arranged into three scales. Optimism, Self- 
confidence, and Unsocialized Attitudes. 

The WRAI was then used in two longitudinal studies: 
'(a) a study of out-of -school Neighborhood Youth Corps 
(NYC) programs in four cities involving 502 subjects ' 
^nd in which the WRAI was administered three times, and 
(b) . a study of the second- deiijonstration of a New Educa- 
t^ional Program (N9P-2) in five manpower programs invol- 
ving 526 subjects. . 

Results indicated that the WRAl/was able to differen- 
tiate between subjects making a "good" and a "jDOor" adjust- 
ment to work and that the change in WRAI scores': while 
part :^Gipa ting in the NYC program was in a* positive direct ' 
t ion for subjects making a' "good" adjustment to wqrk, and' 
negative for subjects making a "poor" adjustment. WRAI . 
scores were also found to be associated wii:h the coxjinge- 
lor's rating of the subject's interest in an educational 
program, of the uselfulness of tb^ program, and with 
achievement test scores in reading Wd mkthematics. 

Test^retesti correlations with the two administrations 
over a year apart were- in the .60's fot total WRAI scores. 
Since there was measurable change in scores 'between the 
two administratipns, it. can be . expected that, the correlations 
would have been ^substantially higher if the time span be- 
tween administrations had been shorter. 

It was concluded that the WRAI had demonstrated its 
potential use as a meas.ure of program effectiveness and : 
as a. help in diagnosing the needs of new prograrji participants/ 



TIffi -MEASUREMENT Ocp wORK^RELEVMin' ATTITDKES^ 

e 

Background ^ \ . * 

This paper reports*^ the final phases in the devel- 
opment of a. Work -Relevant, /Attitudes inventory (WRAI) . 
Early developmental woi^k was reported t6 the Manpowiar 
Adminij^ration in October, 1970.1 ^ 

The 'work on the development of the inventory began, 
after review of the research literature, with the se- 
lection of a .poor of 72 itemg. These items were admin- 
istered to 8S dut-o:^-school Nei'^hborhood Youth Corps . 
(NYC) enrollees in Cincinnati and to 78 New Career en- 
rollees in Durham. Performance ratings, were obtained 
from counselors for each subjegt. A factor analysis, of 
the ^72 items produced three interpre table factors : Op- 
timism, Self-confidence and Ujfisocialized attitudes. The 
working hypotheses as to the meaning of the three factors 
were: . 

1- Optiniism-.r^e degree to which the individual 
assumes that the intentions of other people ar\ 
benevolent and that satisfactions can be expected' 
in the natural course of events. 

2. Self -confidence — The degree to which the indi- 
vidual'* believes that he can by his- own actions in- 
fluence future ^ents. - 

3, Unsocialized a^ttitudes — The degrefe to which the 
ind^v'idual fails to accept the requirements of social 
living. 



■"■Regis H. Walther, The Measurement of Work-Relevant 
Attitudes (Springfield, Virginia: National Technical 
Information Service., 19,70, NTIS #PB1959fe6) . 

t 



The items were then grouped into three scales 
designed to measure these variables. An item was • in-' \. 
eluded in a scale if ;Lts qontent appeared to be related 
to the hj^pothesie for the scale/ if ityloaded signifi-l 
cahtly Oh the relevant factor^, and if it dif ferentiatji 
between criteria groujts. 

A revised inventory of 34 items was prepared for use 
in further developmental work.. Items were added or re- 
written to improve their quality/, and ineffective items 
were eliminated. The revised inventory was administered 
to three out-of-school -groups (NYC, New Careers, and • ' . 
delinquents) and four in-sehool groups (NYC in-schpol 
enrollees, and students in an urban high school, cin inner 
cityvhigh school, and a vocational urbap high school). 
The inventory differentiated on the basis of sex", race, 
and school status with the largest proportion of the 
variance associated with school status. A f^ct;or analysis 
of the items suji^orted the previous conclusion that 
Optimism, Self-confidence, and Unsocialized Attitudes were 
three important underlying dimensioniS^ ' 

Ten items from the inventory w^re indiluded in an 
interview schedule administered to 306 black'^male high 
school dropouts interviewed approximately, two and one-half 
years after dropping out of school. A composite , score 
developed from the' items was found to differentiate in th€ 
expected direction between" subjects making a "good^ and 
a "poor" adjustment to work. 

The full 34-itM[i inventory was tlife^ used in a lon- 



len 
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gitudinal s;tudy of NYQ^^and New Career fnrollees, with the ^ 
inventory being administered at the time o:^ enrollment and 
p^rformance^ratings being secured six months to a year af- 
ter enrollment. The results were ambiguous. In general, 
differences in the predicted direction were found for 
females but not for males. 

the inventory was then revised a second time on th^ - 
basis of the analysis of the items and *reduced to 26 items 

■ ■ ■ ■ ■ .J 



for 'Use in \the studies^ being reported in this paper. 

Tlfie purpose of the research . reported in this ^aper 

* * 

was to 6xami^e further- the— validity of the WRAl: to 
analyze more <^ata in ord^r to sfee whether the WRftI was 
associated, as expiBCted, with independent measures* of 
performance. . ■ * ' ^ 

The value of the WRAI as a tool for program admin- 
istrators hinged on the results of this validation re- 
i 

search. If the results indicated WRAit validity, this 
short, self-report instrument could provide the ^admin- 
istrators of training programs with a usaful, easy-rto- 
wuse method that- would be helpful in 



1. Diagnosing ^ some of the needs of new participants 



^n^ 




• 2. Hanning participation; and f /• 
V 3. Evaluating or estimating program effecl 
Study Desicm ' 

The effectiveness of tfie Work-Relevant Atltr 
Inventory in predicting criteria of progi^am effectiveness 
was researclied in'^two independent studies. The first was 
a longitudinal study- of out-of-scehool Neighborhood Youth 
Corps enrollees in four cities; and the secpnd ,was a 
longitudinal study of students in an experimental educar 
tion p^rogram in five sites. The .research design of both 
studies included the WRAI. * 

In the NYC study, a study group of approxii^tely 
125 in-each site (Atlanta, Baltimore, Cincinnati, and 
St. Lotjis) was constituted in 1970 by including : every hew 
enrollee after a J^elected date until the desired number 
was reached. The cOTiposite group totaled 502 subjects. 
The WRAI was administered in its entirety at the time the 
subjects enrolled in the program and as part of the 1st 
follow-up interview condu<^:ed several .months after they 
had terminated. A shortened version, dbmposed of 13 items 
was administered as part of the 2nd follow-up interview * 
a little over a year later. Subjects participated in the 
NYC program an average of about ten months, and the time 
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sj^an between time of entering the. program and time of 2nd' 
folld^up interview was over two an'd a half years. Use- 
ful responses to the WRAI were obtained from 498 subjects 
at time of intake /from 306 'subjects a;|kf^tirae of 1st 
follow-up .intQrviewl, and from 353 subjects at the 'time 
of the 2nd ' follow-up interview. . ^ 

The second study used an abbreviated 12-item^ form 
of the WRAI as part of the intake interview foir five pro- ^ 
gi^ams participating iii a second Nfew Education Progrcim 
(NEP-'2) demonstration project which involved adolescent 
and adult academic underachievers . 2 These students *Were 
located 4^ five sites, as follows: 

1. A maximum and a minimum security youth correc- 
tional institution in Contra Costa Coupty^ Califor- 
nia. '^The total number of subjects at the two facil- 
ities was 196. 

2. - The MDTA Skills Center in Pacoima, California, 
'94 subjects.- " * 

3. An out-o$-schQoi NYC program in Long Beachr Calif., 
92 subjects . 

4. An out-of-school NYC program in Spokane, Wash., 
95 subjects. 

5. A ^dropout -prone class in Aviation High School, 
Redondo Beach, Calif., 49 subjects. ^ . 

Th^ total number of NEP-2 subjects was 526. The study 
lasted approxima^ley a year and ratings on attributes of ^ ^ 
the pubj^ct's interest and progress in the ptogram were 



1 , 

■^St. Louis subjects had to be eliminated from the # 
sample due to faulty ^administration by the interviewer. 
This study is reported in Regis H, Walther and Margaret ' 
L . Magnus s on , A Longitudinal Study of Selected Out-of- 
School NYC-2 Programs in Four Cities (Washington. D.C.; 
Manpower ResearcTi Projects,. 1975). 

2rpi^« gtudy is reported in Regis H. Walther and 
Margaret E. Magnus son, A Study of the Effectiveness of the 
Graham Associates ' Demonstration Projecj/t on Education 
Programming in Manpower Training Projects tWai^hington, D.C. 
Manpower Research Projects, 1975). . 



made at intake, at termination* and at monthly?' inter- 
vals while they wer^ participating in the program. 
Achievement tests in reading and mathematics were ad- 
ministered at intake and at intervals of three months. 
The imj gtudv y \ . - - 

The major objective of th^ Work -Relevant Attitude 
part of this study was to investigate the predictive 
validity q± the WllAI with respect . to the quality of 
work experience^ ^ Efforts were made to loc^Mte and inter- 
view all the 502 subjects included in the study. If a 
subject had held a /jfob since terminating from the NYC, 
effort^ were made to obtain a report from his employer 
on the type, extent, and quality of h±B work. Based on 
the avai^latT^e'^ information, a rating was made on a scale 
of 1 to 4 of how well the subject had adjusted to work. 

Subjects whbse records indicated' that they had not 
been in the world of work to any appreciable extent 
(subjects in school, trainin<^ programs, the Armed Forces 
and husband-supported housewiveis without work experience) 
were eliminated from consideration, as were a few siibject 
whose records were incomplete or unclear. In all, 372 
subjects could be rated and were placed in one of the 
four following categories: 

1. Good work adjustment. Subject currently in full 
time job which paid at least $2.50 per hour (for 4^ 
males) or $2.00 per hour (for females). Subjects in 
thip category maintained an employed status while 

^ in the civilian labor ce, and received " adequate" 
or better performance ratings from .their employers. 

2. Fair work adjustment. Subject had maintained 
employed status for a substantial portion o:^ the 
period of his labor force participation, but there 
were one or more deficits in his employment. Def- 
icits included current unemployment or current J^art 
time employment, substandard rates of pay, and mar- 
ginal Vork performance ratings fijom imployers. 

\ 3« Minimal work aSju^tment. Subject had some^^c- 



gessful experience with work, but most of the 
^\ measures, indicate a poor adjustment, to w6rk. . 

*4. Poor work adjustment. Subjects in this c^,te- , 
gory h^d worked but their job performance hsCd beeii 
unsatisfac^tjry, or'Tihey liad not ktept their jcSbs- 
long enougp for their perforinancei to be evaluated 
and did not have alternate sources of support. 
This category al/so included sub'jects whose first 
interviews indicated poor work adjustment and who 
could not be located for their second interviews, 
as well as subjects who had been in jaul most of 
the time since leaving the NYC. 

The WRAI was^ initially scored by simple addition 
or subtrai:tion of the items to create a compbpite score . 
The decision whether to add or Subtract was made- on the 
basis of the 'direction in which the items discriminated 
between the criterion groups in the earlier study. The 
first step in the analysis was to compare the good ad- 
justment -group (category 1) with the poor adjustment 

c 

g2;oup (category 4) • WRAI scores were ^ound to be signi- 
ficantly correlated with outcomes at all three adminis- 
tratlons. Tabid 1 reports the results for the adminis- 
tration at tune 6f enrollment. Forty-s^veTn percent of the 
"good" group were in the upper range of scores compared 
with 20 percent of the "poor" group. The scores ^ere more 
predictive for females than for males. 

Table 1 Work -Re levant Attitude Inventory Scores at Time 
of Enrollment and Outcomes by Sex 



Males Females , Total 

WRAI scores Good Poor Good Poor Good Poor 

N=29 N=84 'N=20 N=],24 N=49 N=208 

High 38% -15% • 50%. 23% 47% 20% 

Medium ^ 35 49 40 54 37 52 - 

Low 27 36 ' 0_ 23 16 28 

Totial 100% 100% 100% 100% 100% lOO/c 
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The association of WRAI scores and outcome? evident ^ 
in the' analysis of the intakse data increased, in the second 
and third administration (see Table 2) . 

Table 2 Work-Relevant AttitudeB. ai Time& jQf lat ^Ild 2nd 

' Follow-up Interview and Outcomes by Sex ^ 



WRAI scores 



Males 



Females 



Total 



Good Poor, Good Poor GoOd Poor 



1st follow-up 


interview 


N=26 


N=51 


.N=18 


N=78 


N=42 


N=129 


High' 




46% 


14% 


83% 


13% 


61% 


13% 


Medivim 




46 


47 


11 


53 


32* 


50 


Low 




8 


39 


6 


34 


7 


37 


Total 




100% 


B.00% 


100% 


10.0% 


100% 


100% 


2nd^ follow-up 


interview 


N=27 


N=55 


N=15 


N=95^ 


N=42 


N=15d" 


High 




48% 


26% 


' 53% 


13% 


50% 


17% 


Medivun 




41 


35 


33 


30 


38 


32 


Low 




11 


40 


13 


57 


12 


51 


Total 




100% 


101% 


^9% 


100% 


100% 


ti 100% 



The* WRAI was designed both as a potential diagnostic ^ 
instrument for use with individuals and ae a possible measure 
of program effectiveness. In the NYC study, ^thtB^ second ad- 
ministration of tfte WRAI occurred when most siabjects had 
been out of the NYC for several months. Comparisons of second 
administration results with those of the initial administra- . 
tion indicated that significant positive attitudinal change 
occurred in the "good" group; .while, in the "poor" group 
negative attitudinal change occurred (see Table 3) . Com- 
parisons of second and third administrations of the Work-' 
Relevant Attitude Inventory showed no significant attitudinal 
change. It should be noted that most.' of the time between 



Table 3 



Ave;cage Change in Work -Relevant Attitudes Score 
between Time 1 (Intake) and Time 2 (first follow- 
up interview) by Outcomes and Sex 



Males 



Females 



Total 



Good Poor 
N=25 N=50 



Good poor Good Poor 
N=^18 N=77 N=43 N=127 



Mean chang^ score 
Standard deviation 



2.72 -.40 1.83 -1.33 2.35, -.96 
5.65 7.86 7.41 .5.45 6.38; 6.49 



the; first and secbnd administrajtion was spent parti- 
cipating in the NYC program. 

The analysia^p to ±his point has been^ base'd^on a 
comparison of caH^egory 1 Jthe "good" group) and category 
4 (the ^•poor** group) V V^en the analysis was extehded^^V^^^ 
all four categories of work quality it was^ found that 
the WRAI predicted better for females than for males and 
that the correlations were higher for the second and 
third administrations than for thp first (see Table 4). 
All but one of the correlations were statistically signi- 
ficant. The highest correlation was .44 for the 148 fe- 
males who took the WRAI during the ..second administration! 

Table 4 Correlation Between the WRAI and Outcomes At 

Times of Administration by Sex 



Males Females Total ^ 

Tijne of Administration N R . ^ R „ N R 

First 1S4 .42 ' 204 .26 • 368 .18 • 

Second 117 .31 148 .4*4 , 265 .38 

Third ' 134 .18 174' .36 308 .28 

The apparently greater predictive power pf the WRAI 
for the quality of work adjustment of female sub7ect3 
could be explained by differences in the kinds of work 
available to male and female sul^jectX. A review of the 
job experiences 'of^ male subjects indicated that they 
could gftt casual "secondary labor market jobs" that paid 
$2.5^, or more, an hour much more easily than cpuld 
fettiales. Casual work for females, such as baby sitting 
or other domestic services, usually paid much less and 
might be unacceptable to the young women included in the 
study group. Therefore, it took greater effort for fer- 
mai^^a-io obtain good 'jobs and any success was an indica- 
tion of favorable attitudes toy/ard work. For the male 
subject- the effective factor in' job adjustment might be 
job tenure. 1 v , 

The sex-associated differences in WRAI predictive 
power resembled differences apparent in some of the de- 



yelopmental work with tHe WRAI ^(see pfZ) , 'in which the 
WRAI was a better. preaictor -of training jprogr am perfor- ^ 
mahce for females, than for male, trained. The absence 
of any statistically significant relati^nsljip- for male^^ in the 
developmental -study may have been xiue t6 small sample size. 
, Conclusions/ NYC Studv ♦ . , 

. The NYC study ciemons traced that there, was a signifi- 
cant association between JTOA I Scores ind employjfleht out- 
comes^ and. that on the ba,sis of WRAI scores relatively few 
l^tis.takes would be made in predicting a subject would ''fall 
into the high group when he bej.1^nged in the low or vice- 
V verga. ' ^ . * , 

' It was alsQ found that th^ whil scores of subjects 

making a '"gpod" empldyment adjustment chang^edjin a posi- ^ 

tive di:rection while they were in the program; whiltf. 

the scpr#s of subjectsif1haking"*a *'^oor" adjustment tended ^ 

to change in a negative direction. v - 

The NEP-2 Studv ' 

The criterion measures' in the New Education Program 
'\ (NEP-2) demonstration project study involved interest and . 
performance xn an education program.- TPhese measures were: 

1. Rating of the studeitt's interest in the program 
at; the time he entered the* class; 

2. ^The' student ' s score on entry achievement tests; 
and , 

3. - the teacher's rating at time the student termina- 
ted how useful the program experience wa^s to the stu- 
dent. 

Althoijgh NEP-2 study data did not include ^employment 
outcomes and could not, therefore, provide criterion 
measures of work adjustment; the NEp-2 criterion measures 
were useful in evaluating the validity of the WRAI*. Eval- 
uatioh results for these measures are^ reported below. 
^trv interest rating . 

WRAI scores were very significantly associated with 
entry interest ratings (see Table 5). The possibility of 
a serious j^'halo effect" should be considered because the^ 
interest rating was madj|^^ after the Work- 
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Relevant' Attitude questions w*re asked. ^The interviewer 
could not, however, immediately interpret^the meaning of 
the responses because he had no. norms to compare them to. 

Table 5 Students* Interest in* NEP-2 and WRAI Scores at 
Time of Entry by Sex. 







Males 








Females 




Total 






Mean 


S 


.D. 


N 


Mean S.D. , 


N 


Mean S 


.D. 


Interest 




















High 


99 


15.12 


3 


.47 


91 


16.60 3.32 


190 


15.83 3 


.39 


Medium 


150 


12.79 


3 


.27 


40 


14.58 3.62 ■ 


'190 


13.17 3 


.42 


Low 


8 


11.12 


4 


. 21 


32 


13.76 3.29 


110 


15.90 3 


.92 


Correlation 


of. 


















interest 


and 


/ 
















WRAI (R) 




.34- 








.41 * 




.40 





Entry Achievement Tests ' ^ 

Students entering NEP-2 were tested with wide-range 
screening tests in' reading (RJSl) and in math (MJSl) , both 
of which were developed by ^he Job Corps. Entering students, 
were then tested with «,the appropriate level of the^ Stanford ^ 
Achievement Test (SAT) in reading^ (paragraph meaning) and, 
in math arithmetic cpmputations) . 

^ ^ Table 6 lists the correlation between the Ij^RAI items 
a^fw'^the Paragraph Meaning subtest of the SAT. The last 
four items were eliminated and a composite score created 
from the other eight ii:ems. A highly significant correla- 
1;ion was found for both males' and females between the com- * 
.posite score 'and all the achievement .tests . One can only 
speculate about the reasons f or *he correlation. It may be 
that academically able pegple develop better attitudes 
because their success with reading and mathematics gives 
them more confidence in themselves. Another possibility ig. 
that students with better '^attitudes try harder -and therefore 
learn more.»>. Or it may be that students who answer attitude 
questions in a more sdcially\acceptable manner make more of 
an effort on tests and thus get higher scores. In any event # 
these results provide validity evidence for the WRAI since 
• its scores were found to correlate with an objective measure 

14 




. , . . • 

of p^formance. The relatively low values of the corre-^ 
lationa Ao not detract from thS conclusion since many fac- 
tors independent of attitude almost cert^^inly - influence 
achievement scores. * 

Table 6 Correlation Between WM\J. Items and. Scores .on 

the Paragraph Meaning Subtes't of the SAT by 
Sex 



4. 



Males Fen]iales * Total 



13 M9.st) bosses have it in for 
: "you ^ 

6' Success is a matter of luck 
8 . The wise person lives for 

^ today 
3 You feel you vhave little 
influeno^ 
11 . Most people cannot be t;rus- 
ted 

22 You get even with people 
who wrong you 

Yo\x are generally enthusi- 
astic about new" plans 
17 Yqu feel happy" 

23 Your chances of being respec- 
ted and law abiding are good 

21 During your spare time, you ^ 

have thing^^to do that you 

like doing 
12 A high schodl education is 

worth the effort 
20 You expect to do well in the 

things you try to do 



-.28 


f --36 


-.34 


-.27 


-.36\^ 


-.30 


-.25 


-.23 




-.22 . 


-.22 


-.23 


-.17 


^. 30 


• -.23 


-.11 ' 


-.22 










.05 


'-.27 




f06 


.17 

•* • 




.05 


.11 


.11 



.12 


■.02 

\ ■ 

r.09 


.08 


.07 


-.07 


.07 


.04 


.05 



Usefulness rating ^* ^ 

The teachers made an evaluation at the time the si 
dent terminated from the program as to its usefulness to ^) 
the student. A small but significant correlation was found! 
indicating that students with high WRAI scores, on the J 
average, were considered to have gained more from the' pj:a::?^ 
gram than students with low scores (see Table 8) . 
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Table 7 Correlations between Achievement Tearts and WftAI 
Sgores> 



Tests 


Males 
N=316 


' Females 

N=a4 3 ■ 


Total 
j N=459- 


RJSl 


.31 


.46 


. 38. 


MJSl . - 


.25 ^ 


.31 


.31 


SAT Reading test 


.3:7 


.50 


.46 


SAT Math test 


.28 

i 


.36 , 


.33 


Table 8 Rating of Usefulness of 
WRAI Scores 


NEP-2 to the Student an^ 



Usefulness Males Females " Total" ^ 

Rating ^ N :Mean S.D. N Mean ; s:d^ N Mean S.D, 







^ 
























Very 
























■3 




useful 


128 '14. 


18 


3 


.47 


128 


16 


.03 


3.44i 


256 


15 


.11 


.57 


Somewhat 
















^3.1^ 












useful 


166 13. 


21 


3 


.71 


39 


14 


.30 


^205 


13 


.42 


3 


.64 


A waste 




























of time 


35 12. 


07 


4 


.65 


-^16 


13 


.89 


3.91 


51' 


12 


.64 


4 


.48 



ConclUsdOns^ NE#"2 study \ 

The NEP-2 study delffonsllra^ed that the. WRAI scores 
correlated* significcintly with a ratii>g' of ^^tudent interest ' 
afef time of entering NKP-2, with reading and math achieve- 
ment test scores, at that time, aijd with the teacher's 
fating of the usefulness ^of .the 'NEP-2 to^ the ♦ student . 

Factor Analysis of the WRAI Items 

a> Iki ^>revious stviclies ^the WRAI was found to have 
"fchrae, interpretable factors which w^re ncim^d. Optimism, 
Sel^-contidence, and" Unsocialized attitudes. A factor ' 
analysis was conducted on the '^NYC 1st interview (Time 2) 
data, because the scores for this administration corre- 
lated best with the work adjustment criterion. The re- 
sults of factor analysis yere similar to those of the ear- 
lier study although the-^oadinga of the^ items were not ai 
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high, reflecting, perhaps, more unreliability -becaus.e the^ 
(lata had been collected 'by a number of interviewers in four 
cities. St. Louis was eliminated because of improper 
administration. The following results were based cffi the 
responses of 311 subjects: ' 

Factor I 

► , Unsocial ized Attitudes 

Item ' Loading 

13 Most bosses have it in- for you ^ .55 

14 " Most' worlc is dull and boring ' .50 
11 People cannot be trusted .46 
10 It is hard to get ahead without breaking 

the law ^ \ ' .46 ^ . 

6 Success is a matter of luck; hard work 
doesn't help .46 

18 Teachers have had it in for you ^ .39 
8 A wise person lives for today * .36 

4 You- do things you regret- . .36 
22 You get even with people who wrong you* , .32 

Factor II ^ Q 
Optimism • ^ . 

17 You feel happy " .54 

5 ' You don't get much ^ fun out of life -.44 
21 During your spare ^time you haVe something, 

to do you, like doing ' .41 

25 . You feel you have been lucky .38 
'24 Your cheoices for a happy home life are 

gcfod ^ .33 

2 You believe most people want to h61p you .3(J 

26* You have a grea^' mahy enemies -.25' 

Factor III K 

19 You feel like a flailu'rfe -.44 , . ^ 

7 You feel as capable and smalrt as most 
people j/ ^8 

2 3 Your chances of being rei^pected ciod law 

abiding are good .31 
1 If you, try hard you -Can succeed, .30 



lb should be noted that the item "You have a great 
many enemies loaded positively on the Unsocial ized 
Attitudes factl^r and negatively on Optimism, This' result 
was consistent with the underlying concept of both scales. 
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Reliability of the WRAI ' ^ , 

Since the vnRAI was administered three times, it wa9 
pos^sible to estimate its test-retest ^Reliability . The 
correlation will, of course^ be an underestimation be- 
cause of fehe^ long time between administrations and the 
evidence that subjects changed' differentially while they.^ 
participated in the NYC program. The test-retest corre- 
lations were reasonably high for the Total Score and 

V f 

substantially lower for the inc^vidual scales (see Table 

9): , . I 1 ■ ^ ^ ■ ■ . _ . 

Table 9 . Test Retest Scores for the WRAI Scales and 
^ Total Scpre for Three Administrations 





Optyjnism 


Self 
Corkf idence 

7 


Unsocial^rf^ed 
Attitudes 


Total , 
Score' 


Time-1 v. 


Time 2 








>Mal6 . 


.40 


.31 \ 


.53 


.57 


Female 


1.47 


• .38 




.67 


Total 


.43 


■.34 


.60 


.62 


Time 2 v. 


Time 3 








Male 


.26 . 


• .25 


.54 


.54 


Female 


.37 


.36 


' .67 


.67 


Total 


.35 


.34 


.62 . 


.63 ' 


Time 1 v. 


Time 3 








Male ' 


.26 


.27 


.36 


.40. 


Female 


.30 


.24 




.48 


Total 


.30' 


.26 


.41 


.44 


<** 





¥r 







The best estimate of th^ overall reliability is Time 
1 V. Time 2 which is .62 and Time 2 v. Tiij^ 3 which is .63. 
.The Unsocialized Attitudes scale has almost the same re- 
Iftability despite the sma^J-er number of items, while the 
Optiioism and Self-confidence scales hav^ significantly lower 
reliability. The females showed higher reliability corre- 
lations than the males, which probably indicates that they 
were more conscientious about JjesponddLng to the question^. 

\ ^ Q 
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Effectiveness of iteittB " \ - 

There was a wide ran^e in the effectiveness of the 
26 items used in the two studies. Some items were^ 
generally useful, others we're^useful for' some purposes 
but not for others and a few items did not correlate with 
any of the criter'ion measures. 

The f-ollowing five items proved to be the most 
effective: • , 

- Most bosses have -it in for you and give you a 
hard time ^ 

- M6st people cannot be trusted 

- You feel that you are a failure . ^ 

V - Teachers have had it in for you and have given 
) you a hard time '/ ' 

^ - feel that you have little influence over the 

tKiings that happen to ^ou 

In contrast, the following four items did not corre- 
late with any criterion measure: ' ^ ' 7 . 

- A high school education is worth all the timeNand 
effoift it requires^. 

a 

- If you try hard enough, you have a chance of 
succeeding in whatever you want to do 

You expect to do well in the things you try ^ do 

- What are your chances of having a happy home JLi^e 
in the future? ^ ' | ■ ' ^ 

The poor itdms had smaller standard deviations and 
the responses were more skewed < than were the good items. 
It seems probable, therefore, that these items tended to 
elicit stereotyped responses rather than individual ex- 
pressions ofwthe subject's view of himself or of the world. 
The good items, on the other haind, apparently reflected 
interpersonal relationships and the .individual ' s feeling 
about his own success and impact on the world around him. 

c < • 

Revision of the WRAI / 

1% was clear from the item analysis that all of the 
26 items of the WRAI were not needed either to maintain 
a correlation with criterion measures or to maintain re- 
liability. A reduction of items to 16 created a shorter 
inventory without losing any of the inventory's effective- 

r 
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ness. ' 

* 

The items included in the. new inventory, the corre- 
lations of ^e items with the total scale score, -and the 
direction -of the scoring are listed below: 



Direction 
plus 



mxnus 



/ 



minus 



Optimism 

1. Yool don't get much fun. 
• out of life (.72) 

1. strongly aqree 

2. somewhat agree 

3. somewhat disagree 

4. strongly disagree 

2. You feel happy (-.6:3^ 

1. almost always 

2. usually 

3. sometimes 

4 . almost never 

3. In your spare time, you 
have something to do that 
you like to do (-.62) 

1. almost always 
' 2 . usually* 
3- sometimes 
4. almost nfever 

4. How many enemies do you 
feel you have? (.54) 

1. a great many 

2 . some 

3. a few 

4. almost none 

Self-confidence 

1. You feel like--a failure (.56) plus 

1. almost always 

2. usually 

3. sometimes 

4. almost never 



plus 



2. ' You feel as capable and 

smart as mosfc^eople (-.62) 

1. strongly agpee 

2 . somewhat agree 

3. somewhat disagree 

4. strongly disagree 

3. You feel you have little in- 
fluence over the things that 
happen to you (/62) 

1- strongly agree 

2 . somewhat agree 

3. somewhat disagree 

4. strongly disagree 



minus 

S 



plus 



0 



f 



4. Your chances of becoming minus 
a ^respected and law abiding 
m^iriber of your community 

1. ^ excellent ' 

,^ 2. reasbnably good 
^ 3 . no.t very g'ood 
^ 4. very unlikely 
Unsoci;^lized Attituiaes ^ 

1. Becoming a success is mainly minus « 
a matter of luipk; hard work 

doesn't help vejry much (-.56) 
1^ strongly agree \ 

2 . somewhat agree 

3. somewhat disagree 

4. strongly disagree 

2. The wise person lives for today minus 
and lets tomorrow take car$ of *^ 
itself (-.52) . \ 

1. strongly agree 

2. somewhat agr^e > 

3. somewhat jJisagree 
* 4. strongly disagree 

3. It is . bard to get ahead withput mii>us 
breaking the law now/^anci ^then (-. 58) 

1. strongly agree 
4 2. somewhat a^ 

3. ' isomewhat disagree 

4. strongly disagree 

> \ ' 

4. Most bosses have it in for'y9^ minus 

and give you a hard time (-.63) 

1. strongly agree 

2. somewhat agree 

3 . somewhat disagree 

4. strongly disagree 

5. You get even wi?^ people who minus 
wrong you as soon as you can 

t. (-.46) ' . 

1. almost always \ 

2. usually V 

3. sometimes 

4. almost never 

6. Most peo>le cannot be trusted minus 

V : (-.53) 

1. strbfigly agree ' ' 

2. somewhat agree 

3. somewhat disagree \ 

4. strongly dis^ree ^ 

4 
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7. Most* work is- dull and minus 
boring (-.60) ' , 

1. strongly agree 

2. somewhat agree 

3. §omewhat disagree 

4. strongly disagree ^^^^ 

8. Teachers have hc^d it in minus 
for you and have .given you ' 

a hard time (-.53) 

1. almost always ' ^ * 
^ 2. usually ^ * 

^ 3. sometimes 

4. almost never * 

Conclusions and Interpretation - 

The^WRAI proved in the reported studies to be an ' 
J^nstrum^nt with considerable promise both for program 
evaluation, and for diagnosis of individuals.. The data 
collection in the NYC study, which provides most of the 
reliability and validity d^ta, could not be tightly con ~ 
^ trolled because of the wide range of circtimstances and 

^ places in which the WRAI was administered:- Nevertheless, 

the test^retest correlations were in the .60's with the 
two administrations a year. or more apart. If the time 
between testing had veen shorter and if the administration 
had been more tightly controlled, thq correlations could 
be expected to be substantially^ higher. 

Tl\e following guidelines are suggested /fm/ using th6 
WRAI,: ^.SZy , 

^- a program evaluation tool - Since the WRAI scores 
have been shown to be associated with employment outcomes, 
and s4jice trainees with "good" oul^coraes change in a positive 
direction and trainees with a "pooi?<" /^outcome chcinge in* a 
r^gative direction, change in WRAI spores during program 
^p^ticipation provides evidence of urogram aca^iievement . '^To 
be used for this purpose the WRAI w6uld neec^to be admin- 
istered- at the beginning and the end of the training program, 

b. As a tool for JLndividual diagnosis - The scales of 
the WRAI can provide useful information about ^e initial 
attitudes of program participants and can be us^eful in the 
counseling process. If used in this way, however, the WRAI 
3hou^ not be used by itself, bu^ only to supplement infor- 



ER|c o ^ ^ 



19 



mation recbived from other sources. The Unsocialized , 
*. Attitudes scale is the most joiepejadable scale aL the pre- 
sent time] The support for the Optimism'' cj^d Self-confi- 
dence scales is mcSre limited^ The revised WRAI can be 
scored by combining the items for each scale listed on ^ 
pages 16H18 througlv addition and ^subtraction sdid computing 
a total score by. adding together the scores for Optimism 
and Self-confidence and subtracting Unsoc^lized Attitudes. 
Standard scofes can be computed by reference to Appendix E, 
which lists the means and standard deviations of iSie . 
out^f-sphool NYC sampie. ^ 
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APPENDIX A 



ERIC 



THE WORK-REL^VT^T ATtlTUDES INVENTORY^ (WRAl)\ 



Responses to the - following items are coded on a 4" 
point scale (l=strongly agree, . 2=soriiewhat agree, 3=soniewhat 
disagree, 4=strongly disagree) . 

1. If you try hard enough, you have a good chancei of sue 
ce6ding in whatever you want to do* 

2. You believe thafc ittbst people want to help you. 

3'. You feel that you have little influence over the 
things that happen to you- / 

4. You seam to do things you regret more often tjian' 
most peopJLe. 

1 / 

5. . You don't get in|ich f^n out of life. 



6« Becom 
work doesn 



ing a success is mainly a matter o^ luck; hard 
n't help very much.^'^ 



7- You feel that you are as capeO^le and smart as ihost, 
people. 

8. The wise person lives for today and lets tomorrow 
^take care of itself. 

9. You would describe yourself as self-confident. 



10* It ite hard to get ahead without breaking the law 
now and then.^ ' , 

, 11. Most people cannot be trusted- 



rea^j 

1.2 



12. A high school education is worth all the time* and 
effort it requires. 2 / ^ 



1. Item used in the .second follow-up interview, NYC-2. 

2. Item used ^ A Study of the Effectiveness 
^ of the Graham Ass'ociate^s * Demonstration Project on Education 

* Programming in ManpoweVj Training^ Projeots^ 



13. Most bosses have it in for you and give you a 
ha):d time.-^' ^ • r - 

14. . Most work is^ dull and boring. ^ 

15. You are generally enthusiastic about new plans .^'^ 

16. You believe most people look out for themselves. 

Answers to the following questions are code9 on a 4- 
point scale (l=almost always^ 2=usuaHy, 3=sometimes, 4= 
almost never) . ; • 

12 

17. Yqu feel happy, ' > ^ 



18. TeacherSi/^hrave hac^ it in for you and have given you/ 
a hard time^l'. . , \ 



19/. You feeJi that you are a failure.^ 

2 

20. You expect to do well in the things you try to do. 



21. During your Spare time, you have something to do 
that yau like doing, '^^ 



22. You get even with people who wrong you as soon as 
you can.^'^ 

23. Would you say that yot«s: chances of becoming a res- 
pected and law-abiding member of your c6raraunity are: 

> excellent, reasonably good, not very good, or very 
unlikely? (l=excellent , 4=very unlike^y> 1# 2 

24. Would" you* say your ^chances of having a hdppy home . 
life in the future are: excellent, reasona^y good, not 
very good, very unlikely? (l==excellent, 4=verY unlikely) 

25. How lucky to you feel you have been in your life so 
far: very lucky, somewhat lucky, somewhat un'lucky, 
unlucky? (l=very lucky, 4f=unlucky) 

26. How msmy enemies do ypu feel you have: a great many, 
some, a few, almost none? (i=a great many, 4=almost none) 

c ^ t 



1» Item used in the second follow-up interview, N^C-2.v 
* 2. Item used in "NEP-2," A Study of the Effectiveness 
of the Graham Associates' Demongtratipn Project on Education 
Programming in Manpower Training Projects. 



Appendix B Comparison^ of WRAI Item Responses in "Good* 
and "Poor" Work Adjustment ^Groups in Three 
Administrations Sex <NYC-2) 







Time i 




Time 2 






Time 3 






A in ii 1 i » 




TOTAL 




FEMALE 


TOTAL 


MALE 


FEMALE 


TOTAL 


NfGood 


N=26 


Jtl A 


N=45 


N=26 


N=18 


N-44 


N-26 


' Nsl8 




N/Poor 


N=54 


N=83 


N=137 


N=49 


N=79 


N=128 


N=l37 


N^68 


N^IOS 


WRAI 




















ITEM # 




















1 


-.90 


-1.3$ 


-1.72- 


-1.37- 


.02 


-1. 10 








" ' 2 


-.43 


-1.01 


- .85-1.89 


-1.07 


-2.12 




2 . 5^^-^ 




\ 3 


« .39 


2^.42 


1.60 


1.07 


4. 34 


3.71 


1.86 


-^65 


4 


1.55 


5 19 


.2.44 


•^:24 


3.69 


2.47 








A- 5 


.43 


1#40 


1.32 


.1.28 


1.62 




c 






6 


-."70 


1.96 


.74 


.67 


1.76 


1.41 


1.64 


2 .06 


2.85 


7 


-.82 


-1.22 


-1.25 


-.52 


-2.35 . 


-1.52 








'8 


-.45 


. 56 


- .03 


.78 


3'.36 


. 2 .96 


.50 


4.78 


3.58 


9 


^06 


.01 


- .18 


-.39 


- .^9 ' 


- .84 








10 


.84 


1.54 


1.42 


^ . 6B 
.25 


1.58 ' 


1.52. 


2*01 


1.50 


2.64 


11 


.87 


2 . 83 


2.68 


w3.44 


2.44 


2. 31 


2 .51 


3 . 92 


12 


-.53 


-1 68 


-1.14 


. .57 


1. 34 f 


- .05 








13 


-.34 


2.14 


.78 


3.72 


3.25 


' ^ 4^.40 


*2.95 


3.39 


4.53 


14 


1.01 


1 32 


1.46 


1.39 


2.30 


1.91 








* is- 


-1.27- 


- .83 


-1.30 


-.26 


- .87 


- .85 


-.39 


- .78 ' 


- :65 


le- 


-1.20 


.45 


-/.71 


:;..26 


.41 


0 








17 


-.56 


-2.02 


-1.73 


-.51 


-1.59 


-1.50 


.15 


-3.45 
2 . 18 


-2 . 58 


18 


1.77 


2.69.^ 


?.78 


a. 61 


3.83 


3. 21- 


-1.03 


.42 


19 


.34 


1.69 


^.4^28 


2.24 


3.17 


3.84 


2.55 


3.53 


•4;57 


20 


-.59 


-1.22 


-1.27*rl.0O 
^ .86 -.18 


-1.41 


-1.62 








21 


.26 


-1.70 


-3.78 


-2.57 


-.90 


-2.42 


--2.45 


22 


.90 


2.01 . 


1.46 


1.53 


-2.66 


2.58 


1.53 


2.44 


2.36 


23 


-.89 


-1.08 


-1 . 07.- 


-1.96 


-1.52 


-2.27- 


-1.51 


-2.70 


-3.25 


24 


-.78 9- .31 


- .m 


-1.38 


- .66 


-r.46 








25- 


-l.*70 


-2.02 


-2.Q.1- 


-1.33 


-1.24 


-1.78 








26 


..w45 


2.96' 


2.50 


1.82 


2.60 


3.31 









^- ^ 

•^ean responses in "good" and "poor" groups compared 
through t-tests. A t-test value of about 2.00 is signi- 
ficant at the .4)S level,. 2.65 at the .01 level, and 3.40 
at the .001 level. A plus means the "good" group scored i 
higher and minus that the "poor" group scored higher. 
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APPENDIX C - " / 




Comparison of Mean Change in Responses to WRAP Items 
• Between Two Administration iritervaisl in NYC-2 Study 
in "Good" and "Poor" Work «f5utconie Gfoups by Sex 

(t-test values)' \ . ^ 



Iterti All Subiecta All Males All Females 
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Time. Ivs2 Time 2vs3 


• Time 


lvs2 


Time 


2vs3 


Time 


lvs2 


Time 


2vs^3 




, Qood Poor Good Poor Good 


Poor 


Good 


Poor 


Gopd 


Poor* 

-• 


Good 


Poor 


i 




0- 


_1 O Q 






-1.84 


1 . 15 






2 




-•21- 


■J . U / 






-1.80- 


-4^. 04 
" 






* 3 


' — .21-1^97-1.16' 


-1.83' 




■2.45 


-.33- 


-1.68 


. 32^ 


■1 . 24 


- 4 


— . . — . ou 


0- 


-1 

"X m D / 






-1.46 


. 33 






5 




- . 84 


n 






.68 


^ . DD 






6 


- .24 -•,22 .74 3.48 


-.42 


• «j z 


0 


1.79 


.24 


— . o y : 


• 1 . oz 


2 . ^8 


7 




1.03 








1.69 


z . o / 






1 8 
N 9 




— . oo. 


. ZD 


.'50 


.87-1.37 


z . yb- 


-1 . y 5 


. 55 




- .63-2.13 


-1.03- 








.18- 


-1 . lo 






•10 


■.1-3 .19-1.20 1.01 


-.61 


— 4 4o- 


■1.04 


. .89 


1.32 


c o 


-. 52 


. 5& 


11 


.70 .66-3.14-1.77 


.1.19 


fi7- 


■4.34- 


-1.18 


-.49 


9Q 
. Z^ 


^ . Zi — 


.1 oi 


. ' 12 


-1.12 -.99 


-1.03 


-.43 






-.44 


-.94 




13 


-2.72 1.81-1.54 -.41- 


-2.43 


2.33- 


■1.36-1.57- 


-1.29 


.39 


-.70^ 




14 


.42 1.81 


.97 


2.00 






-.90 


.72 




15 


-.65 1.44-1.23-1.83 


.53 


.2.05 


-. 94- 


-1 . 60 


.37 


-.13 


r.81- 


■1.{J0 


16 


-2.00-2.37 . • 


-2.19- 


-1.92 






-.49- 


-1.47 






17 


, .68 ' .95 .52-1.17 


.78 


1.29 


.21 


0 


0 


.28 


.57- 


•1.34 


18 


- .8.7-1.25 -.21-3.93 


-.42- 


-1.16 


-.24-2.59 


-.95 


-.71 


0- 


•2.95 


19 


-4.16-1:80-1.00 '1.16- 


-3.09 


-.68- 


•1.14 


-.22- 


-2.92- 


-1.69 


0 


1.45 


' 20 


0 -.85 


0 


-.65 






0 


-.55 






21 


.96tt1.37 -.44 -.25 


.17 


^.34 


'..35 




'1.46- 


-1.47- 


-1.43 


.10 


i 22 


-1.31 -.68 .42 . 0 


-.89- 


-1.14 


.23 




-1.14 


.10 


.57 


-.42 


~ 23 


- .23-1.45 J.. 78 .49 


^ 0 


-.29 


l.Af 


.96 


-.44- 


-1.55 


1.00 


-.16 


24 


.39 -.71 


•H 


-.49 






.27 


-.50 






- 25 


- .81 .08 


-1.07 


^-.67 








.62 






26 


- .63 1.14 


-.89 


1.11 






h°2 


.52 







^ f ^ '^Between first and second admdLnistration (Time 1 v. Time 2) , 

and between second and third admin ii^tr at ion (Time 2 v. Time 3). 
f See Appendix B for N"s and rough interpretation' of t-test values. 
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APPENDIX D 

i 

Means and Standard Deviations WRAI Items, Second 
Administration, KWC Study (N=311) 

Item Means s>D, 

1 " , 1.17 • .44 

2 ^1.87 .73 

3 r.68 1.01 

4 , -2.62 1.09 

5 3.06 1.10 

6 V '3.22 1.01 

7 \ - 1.75 .90 

8 \ / 2.41 1.18 

10 ' 2.90 • 1.14 

-11 2.19 1.05 

12 1.40 .78 

13 2.8,2 1.02 

14 2.68 . 1.02 

15 ^ ' 1.49 .6-6 

16 1.74 .91 

17 ■ . 2.00 " .91 

18 3.11 .85 

19 3.31 . .72 

20 . , 1.57 .70 

21 . 2.09 ' .95 

22 . , ■ ; ^3.14 , .99 
.23 1.93 i .68 

24 . 1,78 \.68 

25 2.04 • . .80 

26 • , . 3.04 1.00 
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APPENDIX E 

WRAI ffcale and Total Score Means and Standard Deviations 
for NYC Sample (N«261) 

Standard 
Means Deviations 

♦ ! 

Optijnism 2.03 2.53 

Self-confidence 2.25 2.02 

Unsocialized Attitudes -22.14 4.64 

Total ^feore 26.42 6.82 " 




